Incremental updating feature extracion for camera identification

Sensor Pattern Noise (SPN) is an inherent fingerprint of imaging devices, which has been widely used in the tasks of digital camera identification, image classification and forgery detection. In our previous work, a feature extraction method based on PCA denoising concept was applied to extract a set of principal components from the original noise residual. However, this algorithm is inefficient when query cameras are continuously received. To solve this problem, we propose an extension based on Candid Covariance-free Incremental PCA (CCIPCA) and two modifications to incrementally update the feature extractor according to the received cameras. Experimental results show that the PCA and CCIPCA based features both outperform their original features on the ROC performance, and CCIPCA is more efficient on camera updating

Study of webcasting on promoting college students’ consumption

With the advancement of Internet technology and the popularization of mobile network devices, webcasting has become a popular entertainment method, and shopping rewards mediated by webcasting have also become a new consumption marketing model. It is of strategic significance to study the consumption behavior of the main groups of consumers under the live broadcast platform. Based on the social media marketing environment, this paper takes webcasting as the research object, and takes game livecasting as the starting point. The impact of webcasting on consumer behavior, combined with relevant theories, try to put forward corresponding reference strategies

Improving Variational Autoencoder for Text Modelling with Timestep-Wise Regularisation

Accepted by COLING 2020, final camera ready versionPreprin

Deep Latent Variable Models for Text Modelling

Deep latent variable models is a class of models that parameterise components of probabilistic latent variable models with neural networks. This class of models can capture useful high-level representations of information from the input data, and has been widely applied to many domains (e.g., images, speech, and texts), with tasks ranging from image synthesis to dialogue response generation. For instance, implicit linguistic cues such as topic information are helpful for various text modelling tasks, e.g., language modelling, dialogue response generation. Being able to accurately recognising dialogue acts plays a key role to help generate relevant and meaningful responses for dialogue systems. However, existing deep learning models mostly focus on modelling the interactions between utterances during a conversation (i.e., contextual information), where important implicit linguistic cues (e.g., topic information of the utterances) for recognising dialogue acts have not been considered. This motivates our first model, which is a dual-attention hierarchical recurrent neural network model for dialogue act classification. Compared to other works which focus on modelling contextual information, our model considers, for the first time, both topic information and dialogue act using a dual-attention hierarchical deep learning framework. Experimental results show that our model achieves a better or comparable performance than other baselines. When applying deep latent variable models in the text domain, one can generate diverse texts via randomly sampling latent codes from the trained latent space. However, several noticeable issues of deep latent variable models in the text domain remained unsolved, where one of such issues is KL loss vanishing and has serious effects on the quality of generated texts. To tackle this challenge, we propose a simple and robust Variational Autoencoder (VAE) model to alleviate the KL loss vanishing issue. Specifically, a timestep-wise KL regularisation is proposed and imposed into the encoder of VAE at each timestep. This method does not require careful engineering the objective function of VAE or constructing a more complicated model architecture, as existing models do. In addition, our approach can be easily applied to any types of RNN-based VAEs. Our model is evaluated in the language modelling task and successfully alleviates the KL loss vanishing issue. Our model has also been tested on the dialogue response generation task, which not only avoids the KL loss vanishing issue, but also generates relevant, diverse and contentful responses. Finally, we investigate the low-density latent regions (holes) of VAE in the text domain, a phenomenon which exists in the trained latent space of VAE and leads to low-quality outputs when latent variables are sampled from those areas. In order to provide an in-depth analysis of the holes issue, a novel and efficient tree-based decoder-centric algorithm for the low- density latent regions identification is developed. We further explore how the holes impact the performance of generated texts of VAE models. For instance, we analyse whether the holes are really vacant, which captures no useful information and how the holes are distributed in the latent space

Fast Online Similarity Search for Uncertain Time Series

To achieve fast retrieval of online data, it is needed for the retrieval algorithm to increase throughput while reducing latency. Based on the traditional online processing algorithm for time series data, we propose a spatial index structure that can be updated and searched quickly in a real-time environment. At the same time, we introduce an adaptive segmentation method to divide the space corresponding to nodes. Unlike traditional retrieval algorithms, for uncertain time series, the distance threshold used for screening will dynamically change due to noise during the search process. Extensive experiments are conducted to compare the accuracy of the query results and the timeliness of the algorithm. The results show that the index structure proposed in this paper has better efficiency while maintaining a similar true positive ratio

A Shapelet Transform Classification over Uncertain Time Series

A shapelet is a time-series subsequence that can represent local, phase-independent similarity in shape. Time series classification with subsequences can save computing cost, improve computing speed and improve algorithm accuracy. The shapelet-based approaches for time series classification have an advantage of interpretability. Concentrating on uncertain time series, this paper tries to apply the shapelet-based method to classify uncertain time series. Due to the high dimensions of time series, the number of the generated candidate shapelets is generally huge. As a result, the calculation amount is large too. To deal with this problem, in this paper, we introduce a piecewise linear representation (PLR) method for uncertain time series based on key points so that the traditional shapelet discovery algorithm can be improved efficiently. We verify our approach with experiments. The experimental results show that the proposed shapelet algorithm can be used for uncertain time series and it can provide classification accuracy well while reducing time cost

A Dual-Attention Hierarchical Recurrent Neural Network for Dialogue Act Classification

Acknowledgment This work is supported by the award made by the UK Engineering and Physical Sciences Research Council (Grant number: EP/P011829/1).PreprintPublisher PD

Random subspace method for aource camera identification

Sensor pattern noise is an inherent fingerprint of imaging devices, which has been widely used for source camera identification, image classification, and forgery detection. In a previous work, we proposed a feature extraction method based on the principal component analysis denoising concept, which can enhance the performance of conventional SPN extraction methods. However, this method is vulnerable, because the training samples are seriously affected by the image content. Accordingly, it is difficult to train a reliable feature extractor by using such a training set. To address this problem, a camera identification framework based on the random subspace method and majority voting is proposed in this work. The experimental results show that the proposed solution can suppress the interference from scene details and enhance the performance in terms of the receiver operating characteristic curve

Learning based forensic techniques for source camera identification

In recent years, multimedia forensics has received rapidly growing attention. One challenging problem of multimedia forensics is source camera identification, the goal of which is to identify the source of a multimedia object, such as digital image and video. Sensor pattern noises, produced by imaging sensors, have been proved to be an effective way for source camera identification. Precisely speaking, the conventional SPN-based source camera identification.has two application models: verification and identification. In the past decade, significant progress has been achieved in the tasks of SPN-based source camera verification and identification. However, there are still many cases requiring solutions beyond the capabilities of the current methods. In this thesis, we considered and addressed two commonly seen but less studied problems. The first problem is the source camera verification with reference SPNs corrupted by scene details. The most significant limitation of using SPN for source camera identification.is that SPN can be seriously contaminated by scene details. Most existing methods consider the contaminations from scene details only occur in query images but not in reference images. To address this issue, we propose a measurement based on the combination of local image entropy and brightness so as to evaluate the quality of SPN contained by different image blocks. Based on this measurement, a context adaptive reference SPN estimator is proposed to address the problem that reference images are contaminated by scene details. The second problem that we considered relates to the high computational complexity of using SPN in source camera identification., which is caused by the high dimensionality of SPN. In order to improve identification.efficiency without degrading accuracy, we propose an effective feature extraction algorithm based on the concept of PCA denoising to extract a small set of components from the original noise residual, which tends to carry most of the information of the true SPN signal. To further improve the performance of this framework, two enhancement methods are introduced. The first enhancement method is proposed to take the advantage of the label information of the reference images so as to better separate different classes and further reduce the dimensionality. Secondly, we propose an extension based on Candid Covariance-free Incremental PCA to incrementally update the feature extractor according to the received images so that there is no need to re-conduct training every time when a new image is added to the database. Moreover, an ensemble method based on the random subspace method and majority voting is proposed in the context of source camera identification.to tackle the performance degradation of PCA-based feature extraction method due to the corruption by unwanted interferences in the training set. The proposed algorithms are evaluated on the challenging Dresden image database and experimental results confirmed their effectiveness